Application Performance On Direct Access File System
نویسنده
چکیده
The Direct Access File System (DAFS) is a distributed file system built on top of direct-access transports (DAT). Direct-access transports are characterized by using remote direct memory access (RDMA) for data transfer and user-level networking. The motivation behind the DAT-enabled distributed file system architecture is the reduction of the overhead on the I/O data path. The goal of this work is to determine whether the architecture of DAFS brings any fundamental performance benefits to applications compared to traditional distributed file systems. To accomplish this, we conduct a performance evaluation of DAFS and compare it to a traditional network storage system: a version of NFS optimized to reduce the I/O overhead. We conclude that DAFS can accomplish superior performance for latency-sensitive applications. Bandwidth-sensitive applications do equally well on both systems, unless they are CPU-bound, in which case they perform better on DAFS. We also found that RDMA is a less restrictive mechanism to achieve copy avoidance than that used by the optimized NFS.
منابع مشابه
USENIX Association Proceedings of FAST ’ 03 : 2 nd USENIX Conference on File and Storage Technologies
The Direct Access File System (DAFS) is a new, fast, and lightweight remote file system protocol. DAFS targets the data center by addressing the performance and functional needs of clusters of application servers. We call this the local file sharing environment. File access performance is improved by utilizing Direct Access Transports, such as InfiniBand, Remote Direct Data Placement, and the V...
متن کاملUSENIX Association Proceedings of FAST ’ 03 : 2 nd USENIX
The Direct Access File System (DAFS) is a new, fast, and lightweight remote file system protocol. DAFS targets the data center by addressing the performance and functional needs of clusters of application servers. We call this the local file sharing environment. File access performance is improved by utilizing Direct Access Transports, such as InfiniBand, Remote Direct Data Placement, and the V...
متن کاملStructure and Performance of the Direct Access File System
The Direct Access File System (DAFS) is an emerging industrial standard for network-attached storage. DAFS takes advantage of new user-level network interface standards. This enables a user-level le system structure in which client-side functionality for remote data access resides in a library rather than in the kernel. This structure addresses longstanding performance problems stemming from we...
متن کاملBuilding a User-level Direct Access File System over Infiniband
In this paper, we present the design and implementation of a user-space Direct Access File System (DAFS) over Infiniband using channel access and portable programming interfaces viz., the Verbs API (VAPI) and the User Direct Access Programming Library (uDAPL). We present an implementation of DAFS using the Virtual Interface Architecture (VIA) for comparison. We discuss design issues in providin...
متن کاملSPIN: Seamless Operating System Integration of Peer-to-Peer DMA Between SSDs and GPUs
Recent GPUs enable Peer-to-Peer Direct Memory Access (P2P) from fast peripheral devices like NVMe SSDs to exclude the CPU from the data path between them for efficiency. Unfortunately, using P2P to access files is challenging because of the subtleties of low-level nonstandard interfaces, which bypass the OS file I/O layers and may hurt system performance. SPIN integrates P2P into the standard O...
متن کامل